Dynamic Databricks Workflows - Advancing Spark